IMAGE PROCESSING APPARATUS AND METHOD 



BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to a method and an 

apparatus for processing an image, and more particularly 
to a method and an apparatus for processing a binary image. 
Description of the Related Art 

Generally, a scanner is configured as follows. 
10 Light is projected onto figures drawn or printed on paper 
or photographs, and light reflected thereby is received by 
a light -receiving element such as a CCD ( Charge -Coupled 
Device). Then, the tone of color is converted into the 
intensity of light for digitization. 
15 An image (halftone dot image) of a binary figure 

or photograph is printed so that a large number of 
halftone dots consisting of a plurality of dots are formed 
on paper at a given pitch. A monotone image is printed so 
that a large halftone dot (consisting of a comparatively 
20 large number of dots) is arranged for a dark portion of 
the monotone image, and a small halftone dot (consisting 
of a comparatively small number of dots) is arranged for a 
light portion thereof. 

Generally, the scanner reads a binary document in 
25 which dot images, line drawings and characters coexist as 
an aggregate of fine dots. A (input) resolution indicates 
how finely the document can be read. 
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In newspaper corporations and desktop publishing 
(DTP) corporations, when a photographic printing paper or 
a binary document transmitted from a remote place such as 
a facsimile image is optically read by the scanner, it is 
5 desired to input images in an image size that matches the 
sheet insertion size. In other words, it is desired to 
input images at a desired resolution. 

However, in practice, the scanner can read the 
binary document only at a fixed resolution because of a 
10 restriction on hardware. Thus, the binary document is 
once input at the fixed resolution, and the image size 
thereof is changed, so that a desired binary-valued 
document can be generated. 

However, in that case, a chess-board like 
15 distortion may occur when input binary data is decimated 
at irregular intervals or is changed in size for 
enlargement or reduction. 

An improved technique taking the above into 
account has been proposed. This technique does not change 
20 the document size based on input binary data of the 
document. Instead, the proposed technique inputs multi- 
valued data of the binary document so as to match the 
sheet insertion size (the gray scale of the halftone dot 
is divided into, for example, 256 gradation levels). Then, 
25 the multi-valued data is converted into binary data in a 
post process. The proposed technique prevents occurrence 
of a chess-board like distortion resulting from decimation 
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and change of size. 

In the proposed technique, a binary image is 
generated by simple binarization (in which a threshold 
value of 127 is used for 256 gradation levels). However, 
simple binarization frequently degrades images, which may 
include a Moire that occurs in a halftone dot image or a 
jaggy noise that occurs in a line drawing or a character 
(a portion that should be originally a straight line has a 
rough contour) . 

Conventionally, simple binarization is employed 
without definitely separating a halftone dot image part 
and a line drawing /character part from each other. 
However, it is desired that the halftone dot image part 
and the line drawing/character part are processed by 
logically different manners in order to obtain high- 
quality output. 

Thus , even if improvement in the image quality is 
attempted by simultaneously employing a Moire smoothing 
process as measures against Moire of halftone dot images 
and a contour emphasizing process as measures against the 
jaggy noise in the line drawing/character part, these 
processes may affect each other, and the expected effects 
would not be obtained. 



SUMMARY OF THE INVENTION 
Taking the above into consideration, an object of 
the present invention is to provide an image processing 



apparatus capable of producing high-quality binary images 
in such a manner that a halftone dot image part and a line 
drawing/character part are separated from each other and 
are subject to respective, most suitable image processing. 

Another object of the present invention is to 
provide an image processing method capable of producing 
high-quality binary images in such a manner that a 
halftone dot image part and a line drawing/ character part 
are separated from each other and are subjected to 
respective, most suitable image processing. 

To accomplish the first object, according to the 
present invention, there is provided an image processing 
apparatus that processes a binary image, comprising: an 
input unit that inputs the binary image as a mult i -valued 
image; a halftone dot image area map creating unit that 
searches for a halftone dot image area that may be in the 
multi-valued image and creates a halftone dot image area 
map; a line drawing/character area map creating unit that 
searches for a line drawing/ character image area that may 
be in the multi-valued image and creates a line 
drawing/character image area map; a halftone dot image 
binarizing unit that binarizes an input image 
corresponding to the halftone dot image area map while 
suppressing input read error that may occur when the input 
unit inputs the binary image, and generates a binarized 
halftone dot image; a line drawing/character smoothing 
unit that smoothes a jaggy contained in an input image 



corresponding to the line drawing/character area map, and 
generates a binarized line drawing/character image; and an 
image combining unit that combines the binarized halftone 
dot image and the binarized line drawing /character image. 
5 To accomplish the second object, according to the 

present invention, there is provided an image processing 
method that processes a binary image, comprising the steps 
of: inputting the binary image as a multi-valued image; 
searching for a halftone dot image area that may be in the 
10 multi-valued image and creating a halftone dot image area 
map; searching for a line drawing/character image area 
that may be in the mult i -valued image and creating a line 
drawing/character image area map; binarizing an input 
image corresponding to the halftone dot image area map 
15 while suppressing input read error that may occur at the 
time of inputting the binary image and thus generating a 
binarized halftone dot image; smoothing a jaggy that may 
be contained in an input image corresponding to the line 
drawing/ character area map and thus generating a binarized 
20 line drawing/ character image; and combining the binarized 
halftone dot image and the binarized line 
drawing/character image. 

The above and other objects, features and 
advantages of the present invention will become apparent 
25 from the following description when taken in conjunction 
with the accompanying drawings which illustrate preferred 
embodiments of the present invention by way of example. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram illustrating the principles 
of an image processing apparatus of the present invention; 

FIG. 2 is a diagram that describes elimination of 
an erroneously recognized halftone dot; 

FIG. 3 is a flowchart of a process of eliminating 
an erroneously recognized halftone dot; 

FIG. 4 is a diagram of a variation of the process 
for eliminating an erroneously recognized halftone dot; 

FIG. 5 is a diagram that illustrates a painting- 
out process; 

FIG. 6 is a diagram that shows gap noise pixels; 

FIG. 7 is a diagram that illustrates an 
interpolation process for gap noise pixels; 

FIG. 8 is a diagram of an original image that 
includes a halftone dot image part and a line 
drawing/character part; 

FIG. 9 is a diagram that illustrates a halftone 
dot image area map and a line drawing/character area map 
related to the original image shown in FIG. 8; 

FIG. 10 is a diagram illustrating a target pixel 
and a proximity area; 

FIG. 11 is a diagram illustrating a process of 
changing the value of the target pixel; 

FIG. 12 is anther diagram illustrating the 
process of changing the value of the target pixel; 



FIG. 13 is a flowchart of a binarization process; 

FIG. 14 is a diagram that illustrates a jaggy 
smoothing process; 

FIG. 15 is a diagram that illustrates a variation 
5 of the jaggy smoothing process; and 

FIG. 16 is a flowchart of an image processing 
method of the present invention. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 
10 A description will now be given of embodiments of 

the present invention with reference to the accompanying 
drawings . 

FIG. 1 is a diagram illustrating the principles 
of an image processing apparatus of the present invention. 
15 An image processing apparatus 10 inputs a binary image of 
a halftone dot and a line drawing/character as a multi- 
valued image, and then performs a binarizing process. 

An input unit 11 corresponds to a scanner or the 
like and inputs a binary image as multi-valued image. 
20 More particularly, the input unit 11 reads a binary 
document at a resolution equal to 256 gradation levels so 
as to match a sheet insertion size. The multi-valued 
image thus read is stored in the input unit 11. 

A halftone dot image area map creating unit 12 
25 searches for a halftone dot image area from the multi- 
valued image, and creates a halftone dot image area map Ma. 
The map Ma is used to recognize the position of the 
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halftone dot image area in the binary document. 

A line drawing/character area map creating unit 
13 searches for a line drawing/character area from the 
multi- valued image, and creates a line drawing/character 
5 area map Mb. The map Mb is used to recognize the position 
of the line drawing/character area in the binary document . 
More particularly, the map Mb is used to recognize an edge 
portion of a line drawing/character. 

A halftone dot image binarizing unit 14 binarizes 
10 an input image corresponding to the halftone dot image 
area map Ma (that is, an input image of the halftone dot 
image area in the input document), while suppressing an 
input read error that may occur when the input binary 
image is read by the input unit 11. Then, the unit 14 
15 outputs a binarized halftone dot image thus generated. 

The values of the halftone dot pixels in the 
halftone dot image area are not absolutely determined but 
depend on a condition of the document placed on the 
scanner and an influence of a physical factor of the CCD 
20 elements. Taking the above into account, the halftone dot 
image binarizing unit 14 does not simply binarize the 
halftone dot image but executes the most suitable 
binarization process that functions to suppress input read 
error as described above. The details of the most 
25 suitable binarization process will be described later. 

A line drawing/character smoothing unit 15 
smoothes a jaggy of an input image corresponding to the 



-8- 



line drawing /character area map Mb (that is, an input 
image of the line drawing/character area in the input 
document), and thus generates a binarized line 
drawing/character image. 
5 An image combining unit 16 combines the binarized 

halftone dot image and the binarized line 
drawing /character image into a combined binarized image, 
which is then stored in the unit 16. 

Now, the halftone dot image area map creating 
10 unit 12 is described below. This unit 12 automatically 
recognizes the individual halftone dots of the multi- 
valued image obtained by reading the input binary image by 
the input unit 11 that may be a scanner. After 
recognition, the unit 12 makes a list of halftone dot 
15 information about each halftone dot, and stores it therein. 
The halftone dot information may include, for example, 
center-of -gravity information (the coordinates of the 
center of gravity of each halftone dot) and boundary box 
information (the coordinates of a boundary box). Thus, 
20 the unit 12 makes, for each halftone dot, a list of the 
coordinates of the center of gravity and the coordinates 
of a boundary box. The boundary box is a rectangle that 
circumscribes the halftone dot. Then, the unit 12 
eliminates an erroneously recognized halftone dot by 
25 referring to the coordinates of the centers of gravity of 
the halftone dots. 

FIG. 2 is a diagram that illustrates how an 
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erroneously recognized halftone dot is eliminated. First, 
the coordinates of each center of gravity are plotted in a 
plot area that is ensured in advance. Black dots in FIG. 
2 denote the centers of gravity. Then, it is determined, 
5 for each center of gravity plotted in the area, whether 
the corresponding halftone dot is the original halftone 
dot or an erroneous halftone dot resulting from erroneous 
recognition of noise or dust on the image. 

In FIG. 2, the center of gravity of the target 
10 halftone dot is assigned a symbol "g" . Masks ml through 
m4, which define search areas, are arranged so as to 
include the center "g" of gravity of the target halftone 
dot. Then, the number of the centers of gravity of the 
halftone dotes in each of the masks ml - m4 is counted. 
15 In other words, a halftone dot density in each of the 
masks ml - m4 is calculated. 

If the number of the centers of gravity of the 
halftone dots obtained per mask is equal to or smaller 
than a given threshold value (in other words, if the 
2 0 halftone dot density does not meet a predetermined 
condition) , the halftone dots in the corresponding mask 
are considered as those of noise or dust on the image 
resulting from erroneous recognition. Then, the 

information about the erroneously recognized halftone dots 
25 is deleted from the list. Further, the centers of gravity 
of the erroneously recognized halftone dots are deleted 
from the plot area. 
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FIG. 3 is a flowchart of a process of eliminating 
erroneously recognized halftone dots. 

[SI] The centers of gravity of the recognized 

halftone dots are plotted in the plot area that is ensured 
in advance . 

[S2] One of the centers of gravity of the halftone 

dots plotted is selected as the center "g" of gravity of 
the target halftone dot. The shape and size of the masks 
that serve as the search areas are determined on the basis 
of the input resolution. This is because the intervals 
and orientations of halftone dots depend on the input 
resolution . 

[S3] The masks are arranged so as to include the 

center "g" of gravity of the target halftone dot, and the 
number of the centers of gravity of the halftone dots is 
counted for each of the masks. 

[S4] If the number of the centers of gravity of the 

halftone dots is equal to or smaller than the threshold 
value, it is determined that there is a high possibility 
that noise or dust on the image may be erroneously 
recognized as halftone dots. 

[S5] The information about the centers of gravity of 

erroneously recognized halftone dots is eliminated from 
the list and the plot area. Then, similarly, another one 
of the centers of gravity of the halftone dots is selected 
as the center m g" of gravity of the target halftone dot, 
and the sequence starting with step S2 is repeated in 



order to eliminate all erroneously recognized halftone 
dots . 

As described above, the halftone dot image map 
creating unit 12 can efficiently and effectively detect 
5 erroneously recognized halftone dots due to noise or dust. 

A variation of the way to eliminate erroneously 
recognized halftone dots is described below with reference 
to FIG. 4, which is a diagram that illustrates this 
variation. 

10 First, an input image area 120 is divided into 

blocks, in which the coordinates of the centers of gravity 
of halftone dots described in the lists are plotted. Next, 
it is determined, for each block, whether the block 
includes an erroneously recognized halftone dot. The size 

15 of the blocks is determined taking the input resolution 
into account. 

FIG. 4 shows a block B that includes the center 
of gravity of the target halftone dot. The number of the 
centers of gravity of halftone dots in peripheral blocks 

20 Bw adjacent to the block B is counted. 

If the number of the centers of gravity of 
halftone dots in the peripheral blocks Bw is equal to or 
smaller than a given threshold value, the halftone dots 
having the centers of gravity located in the block B are 

25 considered as those resulting from erroneous recognition 
of noise or dust in the image. Then, the information 
concerning all the halftone dots included in the block B, 
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which is substantially considered as an erroneously 
recognized block, is eliminated. Further, the 

corresponding plots indicative of the centers of gravity 
are eliminated from the plot area. 

As described above, the centers of gravity of 
halftone dots are grouped into blocks of a predetermined 
size, and the process of determining whether each block 
includes an erroneously recognized halftone dot is 
performed. It is to be noted that this variation employs 
the block-based process, not the dot-based process. Thus, 
it is possible to handle a large number of halftone dots 
at a time and execute the process at higher speed. 

A description will now be given of a process of 
creating the halftone dot image area map Ma. FIG. 5 is a 
diagram that illustrates a painting-out process. The 
halftone dot image area map creating unit 12 paints out a 
boundary box and portions expanding from the boundary box 
on the basis of the boundary box information. Hereinafter, 
the process of painting out portions expanding from the 
boundary box is referred to as an expansion process. 

First, with respect to pixel pi that is 
originally a halftone dot, an area of boundary box bl is 
painted out in accordance with boundary box information 
described in the list from which the erroneously 
recognized halftone dots have been eliminated. Further, 
the expansion process for the boundary box is executed. 
The range of expansion from the boundary box is determined 
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on the basis of the input resolution. 

The above painting-out process is intended to 
recognize, as an area, the position of the halftone dot 
image in the input document. The process of painting out 
5 the boundary box and the expansion process are performed 
with regard to all the coordinates of the centers of 
gravity of halftone dots described in the list from which 
erroneously recognized halftone dots have been eliminated. 

FIG. 6 illustrates a gap noise pixel. More 
10 particularly, FIG. 6 is a diagram that illustrates a 
situation observed after boundary boxes bl - b4 for pixels 
pi - p4 that are originally halftone dots are subject to 
the painting-out process and the expansion process. It 
will be seen from FIG. 6 that a gap noise (gap pixels pn) 
15 may occur. 

Thus, it is necessary to determine whether the 
gap pixels pn are gap noise pixels to be painted out to 
form part of the halftone dot area. 

FIG. 7 is a diagram that illustrates an 
20 interpolation process for the gap noise pixels. White 
frames in an area shown in FIG. 7 are gap pixels pn. A 
mask ml2 that includes the gap pixels pn is set to the 
area. The mask ml2 is depicted by a thick solid line 
shown in FIG. 7. The mask ml2 has a size that is 
25 determined on the basis of the input resolution. 

If the number of gap pixels pn in the mask ml2 is 
equal to or smaller than a given threshold value, the gap 
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pixels pn are considered as gap pixel noise and are thus 
painted out. 

As described above, the halftone dot image area 
map creating unit 12 performs the painting-out process for 
5 the boundary box area, the expansion process and the 
interpolation process for the gap noise pixels by using 
the list from which the erroneously recognized halftone 
dots have been eliminated. In this manner, the halftone 
dot image area map Ma is created. 
10 The line drawing/character area map creating unit 

13 is described. This unit 13 detects a white area and a 
black area that can easily be recognized from the multi- 
valued input image, and recognizes these areas as closed 
areas . 

15 Areas other than the halftone dot image area map 

Ma created by the halftone dot image area map creating 
unit 12 and the closed areas are considered as the line 
drawing /character area map Mb. 

FIG. 8 is a diagram illustrating an original 

20 image having a halftone dot image part and a line 
drawing/character part. FIG. 9 is a diagram illustrating 
a halftone dot image area map and a line drawing /character 
area map, which maps are creased with regard to the 
original image shown in FIG. 8. 

25 A multi-valued original image 100 includes 

halftone dot image parts 100a- 1 through 100a- 3 and line 
drawing/character parts 100b-l and 100b-2, which areas are 
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arranged in FIG. 8. With respect to the original image 
100, the halftone dot image area map creating unit 12 and 
the line drawing/character part area map creating unit 13 
respectively create halftone dot image area maps Ma-1 
5 through Ma-3 and line drawing /character area maps Mb-1 and 
Mb- 2, as shown in FIG. 9. 

Next, the halftone dot image binarizing unit 14 
is described. This unit 14 suppresses input read error 
and binarizes the input image corresponding to the 

10 halftone dot image area map Ma, so that a binarized 
halftone dot image can be generated. 

First, the halftone dot image binarizing unit 14 
sets an area in the proximity of the target pixel that is 
to be binarized and is included in the input image 

15 corresponding to the halftone dot image area map Ma. 
Hereinafter, an area that is set in the proximity of the 
target pixel is referred to as a proximity area. Then a 
threshold value that is valid only in the proximity area 
is adaptively determined on the basis of distribution of 

20 pixel values in the proximity area. 

FIG. 10 is a diagram that illustrates a target 
pixel and a corresponding proximity area. A target pixel 
P to be binarized and an associated proximity area r are 
set in a halftone dot image area Ra corresponding to the 

25 halftone dot image area map Ma. The size of the proximity 
area r is determined on the basis of the input resolution. 

Then, a minimum value min and a maximum value max 
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of pixels in the proximity area r are obtained, and a 
threshold value for binarization is determined therefrom. 
For example, the threshold value may be equal to (min + 
max) /2 . 

5 The threshold value thus determined does not have 

less influence of the input read error, and the quality of 
binarized image can be improved. The threshold value may 
be determined at some intervals of pixels rather than for 
each of all the target pixels . 

10 In a later process, the halftone dot image 

binarizing unit 14 does not merely compare the value of 
the target pixel P with the above-mentioned threshold 
value but changes the value of the target pixel P so as to 
have an optimum value. Then, the optimum value of the 

15 target pixel P is compared with the threshold value for 
binarization of the target pixel P. 

The reason for the use of the optimum value thus 
changed is as follows. The value of the halftone dot 
pixel in the halftone dot image area, that is, the value 

20 of the target pixel P may include input read error as has 
been described with reference to FIG. 1. Even if the 
original value of the target pixel P were compared with 
the threshold value, the resultant binarized image would 
not have good quality. Thus, according to the present 

25 invention, the pixel value is changed so as to eliminate 
an erroneous component and is then compared with the 
threshold value for binarization. 
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The process of changing the value of the target 
pixel P commences performing a priority decision process, 
which determines whether the value of the target pixel P 
should be increased or decreased by referring to the 
5 proximity area r of the target pixel P . 

More particularly, the average value of the 
pixels in the proximity area r that surrounds the target 
pixel P is calculated. If the average value is larger 
than a predetermined threshold value, the target pixel P 

10 is changed so as to have an increased value (toward white). 
In contrast, if the average value is smaller than the 
predetermined threshold value, the target pixel P is 
changed so as to have a decreased value (toward black). 

The proximity area r may be considered as being 

15 full of pixels having small or large values, provided that 
the smallest value of the pixels in the proximity area r 
around the target pixel P is small beyond a given extent 
(for example, the smallest pixel value is very close to 
zero) or the largest value of the pixels therein is large 

20 beyond a given extent (for example, the largest pixel 
value is very close to 255) . This is because the human 
eyes do not have an ability of recognizing the tone of 
each halftone dot in the proximity area r. 

If the pixel values have an inclination as 

25 described above, the value of the target pixel P is not 
changed but is compared with the already obtained 
threshold value in order to attempt to accelerate the 
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binarization process. In other words, the value of the 
target pixel P is compared with the threshold value in the 
absence of change of the pixel value. 

The process of changing the value of the target 
5 pixel P will now be described with reference to FIGS. 11 
and 12. FIG. 11 illustrates a changing process that 
should be executed when it is determined that the value of 
the target pixel P should be increased. FIG. 12 
illustrates another changing process that should be 
10 executed when it is determined that the value of the 
target pixel P should be decreased. 

Referring to FIG. 11, the value of a target pixel 
PI surrounded by a proximity area rl is changed by 
expression (1) when it is determined that the value of the 
15 target pixel PI should be increased: 

Pa = (the maximum pixel value in the 

proximity area) * a (1) 
where Pa is the changed pixel value and a satisfies 0 < 
a ^ 1.0. In the example shown in FIG. 11, the maximum 
20 pixel value in the proximity area is 230. The target 
pixel PI is binarized by comparing the changed pixel value 
Pa obtained by expression (1) with the threshold value. 

Referring to FIG. 12, the value of a target pixel 
P2 surrounded by a proximity area r2 is changed by 
25 expression (2) when it is determined that the value of the 
target pixel P2 should be decreased: 

Pb = (the minimum pixel value in the 
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proximity area) * j8 (2) 
where Pb is the changed pixel value and $ satisfies 1 . 0 
^ 13. In the example shown in FIG. 12, the minimum pixel 
value in the proximity area is 10. The target pixel P2 is 
5 binarized by comparing the changed pixel value Pb obtained 
by expression (2) with the threshold value. 

If the difference between the changed pixel value 
obtained by expression (1) or (2) and the original pixel 
value becomes larger than a predetermined threshold value, 
10 the changed pixel value may be restrained in terms of the 
following. 

If a target pixel of a black pixel is surrounded 
by a proximity area r of all white, the target pixel will 
be changed to have a much larger value because the 
15 proximity area r has a very high average pixel value. 
This may change the black dot to white . 

Therefore, if there is a remarkable difference 
between the original value of the target pixel and its 
changed value, a restraint is imposed on the changed pixel 
20 value. In the above-mentioned example, the black pixel is 
inhibited from having an increased pixel value. The 
difference can be described as follows : 

Difference = | (pixel value after changing) - 

(pixel value before changing)! (3) 
25 where |a| denotes the absolute value of A. 

A description will now be given, with reference 
to FIG. 13, of a process flow of binarization performed by 
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the halftone dot image binarizing unit 14. FIG. 13 is a 
flowchart of the binarization process. 

[S10] The halftone dot image area in the multi-valued 

image is recognized by using the halftone dot image area 
map Ma. 

[Sll] The proximity area r is set to the target pixel 

to be binarized in the halftone dot image area. 
[S12] The average value of the pixels in the 

proximity area r is obtained, and priority decision is 
made as to whether the value of the target pixel should be 
increased or decreased. 

[S13] The threshold is computed from the maximum 

pixel value and the minimum pixel value available in the 
proximity area r. 

[S14] It is determined whether there is an 

inclination in regard of the pixel values in the proximity 
area r. 

[S15] The changed value of the target pixel is 

calculated on the basis of the priority decision made in 
step S12. 

[S16] The difference between the pixel value before 

changing and the pixel value after changing is calculated. 
If the difference is greater than the predetermined 
threshold value, the process proceeds to step S17. 
Otherwise, the process proceeds to step S18. 
[S17] The restraint is imposed on the changed pixel 

value . 
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[S18] The changed pixel value is compared with the 

threshold value obtained in step S13 for binarization . 
Then, all the remaining pixels are processed one by one as 
described above, so that a binarized high-quality halftone 
5 dot image can be generated. 

As described above, the halftone dot image 
binarizing unit 14 binarizes the halftone dot image while 
suppressing input read error. This realizes binarization 
processing in which the shapes of halftone dots can be 

10 maintained and occurrence of Moire can be suppressed. 

Next, a description will be given of the line 
drawing /character smoothing unit 15. This unit 15 
performs a jaggy smoothing process of smoothing a jaggy of 
the target pixels in the input image corresponding to the 

15 line drawing/character area map Mb, so that a binarized 
line drawing/ character having a smoothed contour can be 
generated. 

PIG. 14 is a diagram that illustrates the jaggy 
smoothing process. The shape and size of a mask ml5 is 

20 determined taking the input resolution into consideration. 
Then, the mask ml5 is set to a line drawing/ character area. 

Next , the number of black pixels in each row or 
column within the mask ml5 is counted. Then, the ratios 
of the numbers of black pixels between different rows or 

25 columns are calculated. Thereafter, it is determined 
whether there is a jaggy in the vertical or lateral 
direction by referring to the ratios. If a jaggy is 
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detected, it is smoothed so that the jaggy can be reshaped 
into a smoothed contour. Then, the binarization process 
is executed, so that a binarized drawing/character image 
with a smoothed contour can be generated. 
5 Before smoothing, rows numbered 1-4 and rows 

numbered 8 and 9 in the mask ml 5 do not have any black 
pixel at all. Row number 5 has eight black pixels, and 
rows numbered 6 and 7 have nine black pixels . Thus , it 
can be concluded that the row number 5 has a jaggy. Such 

10 a jaggy is painted out in smoothing, and is reshaped into 
a smoothed contour. The above process is repeated while 
shifting the mask ml5 on the pixel basis. 

A variation of the jaggy smoothing process is 
described below. FIG. 15 is a diagram that illustrates a 

15 variation of the jaggy smoothing process. In FIG. 14, the 
number of black pixels in each row or column within the 
mask is counted each time the mask is shifted on the pixel 
basis . 

In the variation, the number of black pixels in 
20 each row or column within the mask is counted and stored. 
Then, the mask is shifted so as to include a new row or 
column. Then, the number of black pixels only in the new 
row or column is counted. Thereafter, the ratios of the 
numbers of black pixels between different rows or columns 
25 are calculated using the stored numbers of black pixels 
and the newly obtained number of black pixels in the new 
row or column. Then, a rough contour is detected by using 
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the ratios and is then smoothed. 

Assuming that a mask ml5a is located as shown in 
FIG. 15. In this case, the numbers of black pixels in row 
numbers 2 through 9 are respectively counted and stored. 
Then, the mask ml5a is shifted downwards by one pixel. In 
FIG. 15, the shifted mask is assigned a new reference ml5b. 
The mask ml5b includes row numbers 3 through 10. The 
number of black pixels contained in each of row numbers 3 
through 9 in the mask ml 5b has been counted and stored. 
Thus, only the number of black pixels in the new row 
numbered 10 is counted and stored. 

Then, the ratios of black pixels are calculated by 
using the numbers of black pixels that have been stored 
and the number of black pixels newly counted within the 
mask ml5b. Thus, the smoothing process can be speeded up. 

The image combining unit 16 combines the binarized 
halftone dot image and the binarized line 
drawing /character image generated in the above-mentioned 
manners . 

A description will be given of an image processing 
method of the present invention with reference to FIG. 16, 
which is a flowchart of the image processing method of the 
present invention. 

[S20] A binary image is input as a multi-valued image. 
[S21] A halftone dot image area that may be in the 

multi-valued image is searched for, and the corresponding 
halftone dot image area map is created. 
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[S22] A line drawing/ character image area that may be 

in the multi-valued image is searched for, and the 
corresponding line drawing/character area map is created. 
[S23] An input image corresponding to the halftone 

5 dot image area map is binarized, so that a binarized 
halftone dot image can be generated while input read error 
caused at the time of inputting the binary image is 
suppressed. 

[S24] A jaggy that may be contained in an input image 

10 corresponding to the line drawing/character area map is 
smoothed, so that a binarized line drawing/character image 
can be generated. 

[S25] The binarized halftone dot image and the 

binarized line drawing/character image are combined, and a 

15 combined binarized image is output. 

The image processing apparatus 10 and the image 
processing method of the present invention is outlined as 
follows. A binary image in input as a multi-valued image. 
Then, the halftone dot image area map Ma and the line 

20 drawing/character image area map Mb are created. An input 
image corresponding to the halftone dot image area map Ma 
is binarized while input read error is suppressed. An 
input image corresponding to the line drawing/character 
image map Mb is smoothed to eliminate jaggy noise. Then, 

25 a binarized halftone dot image and a binarized line 
drawing /character image are finally combined. 

Thus, the halftone dot image part and the line 
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drawing/ character part in the input image are definitely 
separated from each other and are subject to respective, 
most suitable image processing. Therefore, it becomes 
possible to efficiently and effectively eliminate Moire 
from the halftone dot image part and jaggy noise from the 
line drawing/ character part and to generate high-quality 
binary image. 

The image processing apparatus of the present 
invention includes means for inputting a binary image as a 
multi-valued image, means for searching for a halftone dot 
image area that may be in the mult i -valued image and 
creating a halftone dot image area map, searching for a 
line drawing /character image area that may be in the 
multi-valued image and creating a line drawing/character 
image area map, means for binarizing an input image 
corresponding to the halftone dot image area map while 
suppressing input read error that may occur at the time of 
inputting the binary image and thus generating a binarized 
halftone dot image, means for smoothing a jaggy that may 
be contained in an input image corresponding to the line 
drawing/ character area map and thus generating a binarized 
line drawing /character image, and means for combining the 
binarized halftone dot image and the binarized line 
drawing/character image. Thus, high-quality binary image 
can be generated. 

Also, the present invention includes the image 
processing method that includes the steps of inputting a 
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binary image as a multi-valued image, searching for a 
halftone dot image area that may be in the multi-valued 
image and creating a halftone dot image area map, 
searching for a line drawing/character image area that may 
5 be in the multi-valued image and creating a line 
drawing /character image area map, binarizing an input 
image corresponding to the halftone dot image area map 
while suppressing input read error that may occur at the 
time of inputting the binary image and thus generating a 

10 binarized halftone dot image, smoothing a jaggy that may 
be contained in an input image corresponding to the line 
drawing/character area map and thus generating a binarized 
line drawing/ character image, and combining the binarized 
halftone dot image and the binarized line 

15 drawing /character image. Thus, high-quality binary image 
can be generated. 

The foregoing is considered as illustrative only 
of the principles of the present invention. Further, 
since numerous modifications and changes will readily 

20 occur to those skilled in the art, it is not desired to 
limit the invention to the exact construction and 
applications shown and described, and accordingly, all 
suitable modifications and equivalents may be regarded as 
falling within the scope of the invention in the appended 

25 claims and their equivalents. 
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